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Abstract 

Recent improvements in the method of estimating Renyi entropies 
from measurements of coincidences between the events observed in 
high energy collisions are reviewed. A new, more precise, formulation 
of the method is presented and its accuracy analyzed. 

1 Introduction 

Entropy of a system produced in high-energy collisions is an interesting ob- 
ject, very useful for understanding the physics of the process in question. 
This is particularly important for the search for quark-gluon plasma in heavy 
ion collisions. It is not easy, however, to obtain information on entropy di- 
rectly from data (without additional assumptions about the properties of the 
system). A window which may open such a possibility is to study the coinci- 
dences between observed events. As was suggested in [T], such measurements 
may allow to estimate of the Renyi entropies of the system j2] and thus, by 
extrapolation, give information on its Shannon entropy. This simple idea 
(based on an old suggestion by Ma is, however, difficult to implement 
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lewski@th.if.uj.edu.pl 



1 



[3] and its accuracy hard to determine. These two problems were studied re- 
cently in a series of papers by W.Czyz and the present authors jSJEJ- In this 
note we compile and summarize these results . Although no new results are 
presented (all can be found in [Hj and [6J, we feel that such a compilation in 
a single place will be convenient for the reader and may be useful for future 
applications. 

The object of our study is the M-particle semi-inclusive distribution. It 
is defined by considering a collection of events in which exactly M parti- 
cles were observed in a given region of the momentum space. We shall call 
them M-particle events (independently of how many particles were actually 
produced) 1 . These events can be described by the normalized M particle 
Wigner function W M (X, K) with X = X u Z M , K = K£\ K^ M \ which 
we shall interpret as the M-particle phase-space distribution 

It should be emphasized that the phase-space distribution Wm, describ- 
ing the semi-exclusive distribution, refers only to particles actually measured 
in a given experiment and in a given momentum region. It gives no direct 
information about the particles which are not registered by the detector. To 
discuss the phase-space density of all produced particles, additional assump- 
tions (e.g. of thermodynamic equilibrium) are necessary. 

At this point it is also important to realize that the phase-space distribu- 
tion of particles produced in high-energy scattering is not a precisely defined 
quantity. Apart from the standard problems with the uncertainty princi- 
ple, one has to take into account that particles may be produced at different 
times. In the present paper, following jH], we shall consider the time-averaged 
distribution. 

The aim of this paper is to discuss (i) how the moments of Wm(X,K) 
can be estimated from the measured coincidences of the observed events and, 
(ii) how these moments are related to Renyi entropies and thus also to the 
Shannon entropy of the system. 

To this end we first introduce the effective coincidence probabilities Cm(1) 
of order I, related to the moments of the phase- space distribution by 2 [H] 



These quantities are interesting because, as was shown in [3] (and will be 

lr This terminology is often used in experimental descriptions of multiparticle processes. 
The proper technical terms are: exclusive distribution if all particles are observed, and 
semi-inclusive distribution if besides a given number of observed particles there is an 
unspecified number of other particles. This should not be confused with inclusive M- 
particlc distributions. 

2 To simplify the formulae we shall from now on omit the index M in all quantities. 
Since we are discussing solely M-particle events, this should not lead to any confusion. 
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explained in the next section), for a rather large class of phase-space densi- 
ties, (7(7) defined above can be approximated by the measured coincidence 
probability C exp of the M-particle events [TJ |H] 

N, 

1 ; N(N- 1)...(N + y ' 

where N\ is the number of the observed 1-plets of identical events and N is 
the total number of events. N(N — 1)...(N — / + 1)//! is the total number 
of 1-plets of events 3 . One sees that the measurement of Cl xp reduces to the 
count of the number of coincidences between the observed events. 

As the next step we investigate the relation between C(l), as defined by 
((H), and the coincidence probabilities of the states of the system, C(l), given 
by 

C{l)=Y\ p i\ l = Tr[p l ] (3) 

i 

where the sum runs over all states of the system, Pi is the probability of a 
state i to occur and p is the density matrix of the system. The second part 
of this equality is obvious in the representation where the density matrix is 
diagonal. Since the trace of a matrix is independent of the representation, 
the result is generally valid. 

C(l) defines the Renyi entropy of order I, H(l), by the formula 

ff(0 = -^logC(Z) (4) 

and thus opens a window to the true entropy of the system. Indeed, as is 
well known and easy to show 

3 = lira H (I) (5) 

where S — — J2%Pi log-R; = — Tr[p log p] is the Shannon entropy. 

Unfortunately, since measurement of coincidences can only provide in- 
formation on H(l) for integer / > 2 and, in practice, only for / = 2, 3 and 
perhaps / = 4, the extrapolation procedure is rather uncertain [TT] . However, 
since for / > 1 [T2] . 

S> H(l) > H(l + 1) (6) 

Renyi entropies provide an exact lower limit for S, a quantity very important 
for understanding the properties of the quark-gluon plasma [T3j . 

3 For 1=2 formula @ was first suggested, in a different context, by Ma [3J- See also 

EH- 
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We show that C(l) and C(l) are equal to each other in the limit of infinite 
size of the system. Also the finite volume corrections are studied and shown 
to fall with inverse square of the smallest (linear) size. When combined with 
the previous result, one obtains a reliable method to measure, with a good 
control of error, the Renyi entropies of the system. 

In the next section an Ansatz for the particle phase-space distribution is 
introduced. In Section 3 the corresponding formulae for the effective coinci- 
dence probabilities C (I) are written down and the optimal binning procedure 
is obtained by comparing them with C exp (l). In Section 4 the true coinci- 
dence probabilities C(l) are analyzed in the same framework and relation 
between C{1) and C(l) is explained. Our conclusions and outlook are given 
in the last section. 

2 The phase-space distribution 

To proceed we consider a rather general form of the phase-space distribution 
W(X, K) = 1 G[X/L]e-^ (7) 

\Ll X LlyLl Z ) 

with X/L = (Xi —Xi)/L x , (Z M — Z M )/L Z , K = K 1: K M . The function 
G satisfies the normalization conditions 

/ d 3M uG{u) = 1 -> J dXG(X/L) = (L x L y L z ) M ; 

jd ZM u Ui G(u) = - <X u Y u Z l >=X u Y l ,Z i ; 

J d 3M u(u t ) 2 G(u) = 1 < (Xi - Xi) 2 , ... >= L 2 X , ... (8) 

The first condition insures that e -- "^ is the properly normalized (mul- 
tidimensional) momentum distribution 4 , the second defines the central val- 
ues of the particle distribution in configuration space and the third defines 
L x ,L y ,L z as the root mean square sizes of the distribution in configuration 
space. Both sizes and central positions may depend on the particle mo- 
menta 5 . The form of the function G describes the shape of the multiparticle 
distribution in configuration space. 

The form (J2J) for the time-averaged phase space density is satisfied in a 
variety of models Jl] . It is obviously valid for models which assume thermal 

4 By definition of the phase-space distribution, the momentum distribution is given by 
JdXW(X,K). 

5 They may be also different for different kinds of particles. 
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equilibrium. It can also incorporate expansion of the system, provided X[s 
depend on K[s (the Hubble-like expansion is obtained for Aj ~ Ki). It is 
general enough to incorporate any multiparticle momentum distribution. 

In our further discussion we shall restrict somewhat this general form by 
taking the function G{u) Gaussian: 



where m labels the particles and a labels the space directions. This restriction 
can be avoided at the cost of some complications of the algebra. Since the 
exact shape of the particle emission region is not well determined and since, 
moreover, (JHJ) is not in obvious disagreement with the data from quantum 
interference, we shall stick to it. 

3 Moments of phase-space distribution and 
experimental coincidence probabilities 

Using the Ansatz for the phase space density given by (J7J) and Q , we discuss 
in this section the relation of experimental coincidence probabilities (J2J) to the 
effective coincidence probabilities, determined by the moments of the phase- 
space semi-inclusive densities (0). 

To discuss C exp (l) we have to face the problem of discretization. The 
point is that the measured events are characterized by particle momenta 
which are continuous variables. Therefore, the definition @ is not directly 
applicable: a binning is necessary. Once discretized, the identical events can 
be defined as those which have the same population of the predefined bins 
and thus counting of coincidences becomes straightforward 6 . The counting of 
identical events obviously depends on the binning, however, so the procedure 
is ambiguous [TJ EJ CHj. In order to obtain a viable estimate of C(l), we 
thus have to select the binning in such a way that the result of (j2J) is as close 
as possible to that given by ((H). 

Let us denote the 3M-dimensional momentum bins by j = 1, . . . , J and 
their volumes by uuj. As the first step we express the measured 1-fold coinci- 
dences © by the 3M-dimensional distribution of momenta 




1 



(9) 




(10) 



6 A detailed description of this procedure was given in 0] and applied in |15| . 
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and the binning Uj. This is clearly possible because the observed coincidences 
depend only on the momentum distribution and on binning. The relevant 
formulae are derived in [Hj. 

Next, we consider C(l), defined in (JTJ. Using (JZJ) and (jHJ), a formula for 
C{1) can be written down in form of an integral 



C(Z) = d 3 K 1 ...d 3 K M n(K 1 ,...,K M ;l) 



where 



Cl{K 1 ,...,K M ;l) 



(2tt 



,3M(Z-l)/2 



-lv(K U -,K M ) 



pM/2 



'IV. 



'12) 



(L x L y L z )«-W 

The derivation can be found in 

The integral (jllj) can be of course replaced by a sum over all bins Uj. 

The last step is to compare the formulae for C exp (l) and C(l). When this 
is done, one observes that if the bin sizes are 



U 



M 

n 

m=l 



(2tt 



,3(Z-l)/2 



P/*(L x L y L z p 
where a = x,y, z, we obtain 



M 

nn 

m=l ol 



(27T) 



(J-l)/2 



^ 1/2 (^a)5 



(m) 



(13) 



V . J_ f dKe~ lv ^ 
C(l) = C exp (l) ' p-. (14) 

Note that the product L x L y L z is related to the volume of the system in 
configuration space. 

Eq. (fT3*j) is very general and can be applied to an entirely arbitrary 
discretization procedure. In the simple (but most useful in practice) case 
when L x ,L y ,L z do not depend on K, the components K x ,K y ,K z can be 
divided into bins of constant lengths A x , A y , A z . Then the condition for the 
size of the bin is 

and Uj = [A.A^AJ^. 

Equations ()14|) and define the method of estimating the effective 
coincidence probabilities C(l) from the observed coincidence probabilities 

(jexp 
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The formula (fTljl can be rewritten in a somewhat more intuitive form 

v.. < e -HK) > 

G «(0 = CffiD ^l > (i6) 

which explicitely shows that in the limit when bins are so small that the 
momentum distribution inside each bin can be treated as a constant, C(l) = 
C exp (l). This implies that, as discussed in detail in [3], the accuracy of the 
method improves for large volume (L x L y L z ) of the system. It also shows 
that the method of estimating the Renyi entropies proposed in pQ is only an 
approximation, valid at a very large volume of the system. 
For smaller systems the correction factor 

$ = ^ hms (17) 

may be estimated either from the measured single-particle distribution and 
correlation functions 7 or, more precisely, by Monte Carlo simulations. 



4 Moments of phase-space distribution and 
Renyi entropies 

In this section we discuss the relation between the effective coincidence prob- 
abilities C{1) (defined by the moments of the phase-space distribution ((H)), 
and the coincidence probabilities of the states of the system (defined in terms 
of the density matrix (JHJ) ) . To this end we have to evaluate the trace of the 
/-th power of the density matrix and compare it with the formula for C(l). 

The density matrix can be obtained from the phase-space distribution 
(Wigner function) by the Fourier transform [7j: 

p M (p;p')=p(p 1 ,...,p M] p' 1 ,...,p' M ) = J dXe^ x W(X,K) = 

ee J d 3 X 1 ..A 3 X M e^ + --- + ^ x ^(X 1 ,...,X M ,K u ...K M ) = 

= g-K^b-^Mig-f El' =1 E a ^"jL+'Eli E a ?™«^ W (i8) 

where q = p — p' and K = (p + p')/2, and where we have explicitely used the 
Gaussian form @ of G(u). 

It is seen from this formula that p(p;p') may be diagonal in p,p' only if 
IV [X, K] does not depend on X, a condition which can be realized only if 
the volume of the sytem extends to infinity. 

7 $ depends only on momentum distribution. 
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The non-diagonal nature of the density matrix is in fact the fundamental 
reason for all complications. 

When (118)1 is introduced into (jHJ) we obtain C(l) in form of a multidi- 
mensional integral. In [Oj the first two terms in the asymptotic form of this 
integral at large L x ,L y , L z were investigated. The results are summarized in 
the formula 

C(l) = J d 3 Ki...d 3 K M £l(Ki, .., K M ] I) (19) 



where 



il{Ki,..., K M , I) = 777 77 77 77- l^J) 

W(Ai, K M ]l) 



Cl(Ki, Km] I) is defined in (112^1 and 

Q(K h ...,K M ;l) = Det 

with 



8=1 

" s 2 2s (2s + l)!(/-2s-l)! 
and T is the 3M x 3M matrix 



;2i) 



(22) 



T m a,n/3 j- Vma,nf3 j • (^^) 



where 



V ma = dmaV^Kx, K M ) ] V ma>n p = d ma d n pv{K x , K M ). (24) 

The indices m, n = 1, M denote particles and a, (3 = x,y, z denote direc- 
tions. 

Note that the sum over s is finite, because all a s vanish for 2s > / — 1. In 
particular, for I = 2 all = and we simply have Q(K, ; 2) = Cl(K; 2). 

Comparing (fi"9)) with (JTTJ) one sees that for I > 3 C{1) and C(l) differ only 
by the factor Q(K X , Km] I) under the integral. The first observation is that 
in the limit when all L x , L y , L z are very large, the matrix T ma ^ n p tends to 
and thus the correction factor approaches 1. Consequently, the difference 
between C{1) and C{1) disappears. For finite size of the system, using (|2Uj) . 
the difference can be explicitely calculated from the M-particle momentum 
distribution. 
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5 Discussion 



When combined together, the results reported in Sections 3 and 4, provide 
a substantial improvement on the method of estimating the Renyi entropies 
of a multipartcile system suggested originally in [Tj. First, the discretization 
procedure, necessary to give a precise meaning to the coincidence measure- 
ment, is properly formulated. Second, the role of the size of the system in 
configuration space for the accuracy of the measurement is explained. Finally, 
the corrections due to the finite size of the system are explicitely evaluated 
and can be used to improve the precision of the method. In effect we obtain 
a practical and reliable method of determining the Renyi entropies of the 
multiparticle systems and thus also the lower limit for its Shannon entropy. 
Several comments are in order. 

(i) One sees from (fT3|) that the optimal size of the bin does not depend on 
the average position of the particles at freezeout X(K). One also sees from 
()24|) - (J23*j) that the correction factor O does not depend on it. This implies 
that the momentum-position correlations induced by the i^-dependence of 
X do not influence significantly the measurement of Renyi entropies. 

(ii) It is also seen from (jlHjl that only the volume of the bin ojj m = 
(A x A y A z )j m , but not its shape, matters in the determination of the optimal 
discretization. One can use this freedom to improve the accuracy of the 
measurement by taking bins large in the directions with weak momentum 
dependence and small in the direction where the momentum dependence is 
significant. 

(iii) Our analysis can be applied to any part of the momentum space. This 
is important for two reasons. First, for large systems, when the optimal size 
of the bins is small, a reliable measurement of coincidencies in full momentum 
space may require a prohibitively large statistics. Thus restriction to a small 
part of phase space may be necessary. Second, it allows to measure the 
local entropy density in momentum space (integrated over all configuration 
space). In case of strong momentum-position correlations, the selection of a 
given momentum region can induce, however, a selection of a corresponding 
region in configuration space. 

(iv) The accuracy of the measurement depends on the correct estimate 
of the size of the system. Information from HBT measurements allowing 
to determine the parameters L x ,L y ,L z (and, hopefully, also the shape of 
the emission region JH]) is therefore necessary. One should keep in mind, 
however, that the interpretation of the results from quantum interference is 
far from unique \Tj\. Thus some modelling may be needed. 

(v) It is interesting to note that the effect of the finite size of the system 
tend to cancel when the Eqs. ([Tfi|) and (J2U|) are combined. Indeed, increasing 
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L implies smaller bins and thus decreasing C exp (l). Thus also C(l) evaluated 
from (fTBj) decreases. But one sees from (J2Uj) that then C(l) increases. Thus 
the obtained value of Renyi entropy is less sensitive to a change in size of the 
system than Eqs. (|TB]l and PD|) . taken separately, suggest. 

(vi) Through this paper we have only discussed the M-particle systems 
(at fixed M). The coincidence probabilities including all multiplicities can 
obtained from the relation 

C{l)=Y\ P (M)\ l C M {l) (25) 

M 

where P(M) is the multiplicity distribution. One sees from this formula 
that at large I only multiplicities close to the most probable one contribute 
effectively to C\. 

(vii) It should be emphasized that the method we propose takes into 
account all correlations between particles measured in the experiment. This is 
to be contrasted with the estimate of entropy from the single particle inclusive 
distribution JH] where, by definition, the correlations between paticles are 
neglected (the assumption of equilibrium is used instead). 

To summarize, we have reviewed recent developments [SI IE] of the method 
of estimating the Renyi entropies from measurement of coincidences between 
events observed in high energy collisions [1 j. As discussed in detail, the 
accuracy of the method depends crucially on the size of the system in con- 
figuration space. It turns out that the original idea is strictly correct only 
for systems of very large size. The finite size corrections are derived. As 
shown in [0] they are negligible for systems encountered, e.g., in heavy ion 
collisions. For smaller systems they are more important but seem not to 
be prohibitive even for systems of the size as small as 1 fm. One thus ob- 
tains a new, reliable, tool for studies of the effective degrees of freedom in 
multiparticle phenomena. 

The proposed method does not demand any assumptions about the ther- 
modynamic properties of the system, in particular it does not assume ther- 
modynamic equilibrium. It thus may be of particular interest for testing the 
standard assumptions of the models of quark-gluon plasma. Moreover, it can 
serve as a quantitative measure of the deviations from equilibrium. 
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